TITLE OF THE INVENTION 

HUMAN VISION MODEL BASED SLOW MOTION INTERPOLATION 



BACKGROUND OF THE INVENTION 

The present invention relates to video signal processing, and more 
particularly to a human vision model based slow motion interpolation 
apparatus and method that renders smooth interpolated video from a slower 
rate video source. 

In many video applications there is a need to adapt a slow rate video 
sequence to a higher rate video sequence. Such applications include format 
conversion between PAL (25 frames per second) to NTSC (30 frames per 
second), between film (24 frames per second) and one of the television 
standards, and for presenting slow motion video sequences where the input 
frame rate is reduced. One of the problems is to avoid apparent "jerkiness" in 
the converted video sequence where one frame is displayed for two or more 
display frame periods before the next one is displayed. The prior solution 
has been to interpolate between frames so that there is an interpolated frame 
of video for each display frame. Interpolation may take the form of 
differencing two "anchor" frames and then computing intermediate, 
interpolated frames using either a linear function, frame repeats, a spline 
function or the like. None of these prior forms of interpolation have any 
human vision model components. 

What is desired is a human vision model based slow motion 
interpolation apparatus and method that renders smooth interpolated video 
from a slower rate video source. 



BRIEF SUMMARY OF THE INVENTION 

Accordingly the present invention provides a human vision model 
based slow motion interpolation apparatus and method that renders smooth 
interpolated video at a desired rate from a slower rate video source. The 
slower rate video signal is up-sampled to the desired rate and input to a 
human vision model based adaptive filter that has recursive characteristics. 
The output from the adaptive filter is the smooth interpolated video without a 
direct current component. A direct current (APL - average picture level) 
restorer may be used to add to the smooth interpolated video the direct 
current component from the up-sampled video signal. 

The objects, advantages and other novel features of the present 
invention are apparent from the following detailed description when read in 
conjunction with the appended claims and attached drawing. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

Fig. 1 is a block diagram view of a human vision model based slow 
motion interpolation apparatus according to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring now to Fig. 1 a slower rate or "slow" video signal is input to a 
frame rate converter 12 that up-samples the slower rate video signal to a 
desired higher rate video signal. The higher rate video signal is then input to 
a three-dimensional (3D) human vision model (HVM) adaptive filter 14, such 
as that described in co-pending U.S. Patent Application Serial No. 
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09/858,775 filed by the present inventor on May 16, 2001 entitled "Adaptive 
Spatio-Temporal Filter for Human Vision Model Systems." The output from 
the HVM adaptive filter 14 is a temporally smooth, not necessarily blurred, 
interpolated video signal at the higher rate without any direct current (DC) 

5 component. The output from the HVM adaptive filter 14 together with the up- 
sampled slower rate video signal from the frame rate converter 12 are input to 
a DC restore circuit 16, as the HVM adaptive filter eliminates the DC 
component of the up-sampled slower rate video signal. The DC restore 
circuit 16 determines the DC level from the up-sampled slower rate video 

10 signal and adds that to the smooth interpolated video signal to produce the 
final output "smooth" interpolated video signal. In some instances the DC 
restore circuit 16 may be eliminated. Otherwise the DC level added to the 
smooth interpolated video signal by the DC restore circuit 16 may be a 
constant, may be based on average picture level (APL) from the up-sampled 

15 slower rate video signal, or may be determined in any other way that is well 
known in the art. 

The HVM adaptive filter 14 is a plurality of filters composed of a 
common building block, as shown in Fig. 2 of referenced U.S. Patent 
Application Serial No. 09/858,775. This is a recursive filter architecture 

20 where the output of the filter is multiplied by a constant less than one, 
delayed and fed back to the input for combining with the next frame in 
sequence. The recursive nature of the HVM adaptive filter results in the 
interpolation of the up-sampled slower rate video signal into the smooth 
interpolated video signal. 
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Thus the present invention provides a smooth interpolated video from 
a slower rate video signal by up-sampling to a desired rate and filtering using 
a 3D HVM adaptive filter which is recursive in architecture. 
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